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1  Project  Objectives 


Probabilistic  graphical  models  are  normative  tools  for  managing  dynamic, 
uncertain  situations.  These  models  have  been  finding  increased  applications 
as  they  provide  a  structured  methodology  for  building  complex  situation 
models,  and  a  suite  of  efficient  algorithms  for  reasoning  about  modelled 
situations.  The  structure  of  a  probabilistic  graphical  model  represents  qual¬ 
itative  dependencies  among  situation  attributes,  and  its  parameters  (proba¬ 
bilities)  represent  a  quantification  of  these  dependencies.  Model  parameters 
represent  both  the  strongest  and  weakest  aspect  of  probabilistic  graphical 
models.  Specifically,  it  is  these  parameters  that  allow  one  to  have  fine¬ 
grained  models  of  situations  (compared  to  the  coarse-grained  models  af¬ 
forded  by  symbolic  representations).  Yet,  it  is  these  parameters  that  deci¬ 
sion  makers  find  the  least  intuitive,  as  they  worry  about  their  impact  on 
the  decision  making  process  (i.e.,  what  would  happen  if  we  change  a  .80 
probability  to  a  .85?).  Sensitivity  analysis  is  a  remedy  to  this  concern  as  it 
focuses  on  understanding  the  relationship  between  the  local  parameters  that 
quantify  a  probabilistic  model  and  the  global  conclusions  that  are  drawn  based 
on  the  model.  This  understanding  has  far  more  reaching  applications  than 
is  suggested  above  though,  as  it  can  be  the  basis  for  addressing  complex 
tasks,  such  as  situation  control  and  information-system  design. 

The  objective  of  this  effort  is  to  conduct  an  investigation  into  proba¬ 
bilistic  sensitivity  analysis  for  aiding  the  process  of  situation  awareness.  As 
far  as  technical  advancements  are  concerned,  the  expected  outcomes  of  this 
investigation  will  enable  us  to  (1)  assess  the  impact  of  parameter  changes 
on  the  quality  of  decisions  based  on  probabilistic  models,  (2)  characterize 
minimal  parameter  changes  that  are  needed  to  ensure  the  conformance  of 
a  model  with  expectations,  and  (3)  quantify  and  effectively  measure  the 
change  undergone  by  a  probabilistic  model  when  perturbed  through  pa¬ 
rameter  change.  These  results  are  expected  to  significantly  improve  the 
effectiveness  of  probabilistic  graphical  models  as  a  tool  for  achieving  situ¬ 
ation  awareness.  First,  they  would  allow  decision  makers  to  get  first  hand 
insights  into  the  sensitivity/robustness  of  their  decisions  to  the  various  as¬ 
pects/assumptions  underlying  the  situation  model.  Next,  they  will  give 
them  a  handle  on  how  to  manipulate  the  situation  in  order  to  achieve  cer¬ 
tain  objectives.  Finally,  they  will  expand  the  realm  of  queries  that  decision 
makers  can  ask  about  a  situation  when  conducting  if-then  analysis  (What 
would  flip  the  most  likely  scenario?  What  would  increase  our  likelihood  of 
success?  Is  it  worth  replacing  these  sensors  by  more  reliable  ones?). 

The  proposed  work  involves  both  a  theoretical  study,  and  a  correspond- 
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ing  implementation  of  developed  techniques  into  the  SamIam  system  ( rea¬ 
soning cs.  ucla.  edu/ samiam) . 


2  Project  Accomplishments 

Most  of  our  initial  focus  in  sensitivity  analysis  has  been  on  directed  graphi¬ 
cal  models  in  the  form  of  Bayesian  networks.  Undirected  graphical  models 
(Markov  networks),  however,  are  quite  important  in  certain  application  ar¬ 
eas,  such  as  sensor  networks  and  recognition  applications  in  general,  where 
they  may  provide  a  more  natural  modeling  tool.  One  of  the  main  objectives 
of  this  effort  has  been  to  extend  the  sensitivity  analysis  engine  developed 
for  Bayesian  networks  so  it  can  handle  undirected  models,  at  least  for  the 
simple  case  of  single  constraints  and  single  parameter  changes. 

One  of  the  main  accomplishments  of  this  project  has  been  a  comprehen¬ 
sive  investigation  of  sensitivity  analysis  in  Markov  networks,  which  resolved 
most  of  the  pending  questions  with  regard  to  Markov  networks  as  formulated 
in  the  project  proposal.  Based  on  these  results,  which  are  reported  in  [1],  we 
now  have  the  basis  for  extending  the  sensitivity  analysis  engine  of  SamIam 
to  Markov  networks,  making  this  important  type  of  networks  available  for 
the  same  type  of  sensitivity  analysis  that  Bayesian  networks  support.  The 
ability  to  develop  this  extension  allows  us  to  more  naturally  handle  applica¬ 
tions,  such  as  sensor  networks,  which  have  been  modelled  using  undirected 
models,  in  addition  to  combinations  of  directed  and  undirected  models.  The 
majority  of  these  applications  center  around  sensor  fusion,  with  a  number 
of  sensors  (that  measure  the  same  physical  quantity  such  as  temperature  or 
proximity)  spread  according  to  some  physical  layout.  Model  parameters  in 
this  case  correspond  to  sensor  biases,  and  other  attributes.  The  sensitivity 
analysis  engine  can  then  be  used  to  reason  about  the  impact  of  these  sensor 
properties  on  the  decision  making  process.  We  should  note  here  that  the 
reading  of  a  sensor  can  itself  be  modelled  as  a  model  parameter,  allowing 
us  to  reason  about  the  impact  of  sensor  readings  on  the  decision  making 
process  too.  For  example,  we  may  ask:  Would  turning  this  sensor  on  allow 
us  to  prove  a  certain  hypothesis  beyond  a  given  threshold? 

Sensitivity  analysis  is  usually  focused  on  a  particular  query  type.  The 
most  common  query,  and  the  one  we  have  focused  our  initial  efforts  on,  is 
that  of  posterior  marginals:  the  probability  of  some  event  given  some  evi¬ 
dence.  Here,  sensitivity  analysis  would  be  concerned  with  two  basic  ques¬ 
tions:  (1)  How  would  the  answer  to  a  query  get  effected  by  some  parameter 
change?  (2)  What  parameter  changes  will  induce  a  particular  change  in  a 


3 


query?  One  of  the  main  objectives  of  this  effort  has  been  to  extend  this 
type  of  analysis  to  one  of  the  most  practical  types  of  queries:  most  likely 
scenarios.  That  is,  given  a  most  likely  scenario  in  light  of  some  evidence,  the 
goal  is  to  answer  two  questions:  (1)  How  much  change  to  some  parameter 
would  preserve  the  most  likely  scenario  ?  (2)  What  parameter  changes  will 
flip  the  most  likely  scenario  to  some  other  scenario? 

One  of  the  main  accomplishments  of  this  project  has  been  the  results  we 
obtained  on  sensitivity  analysis  with  respect  to  most-like ly-scenario  queries, 
where  we  showed  that  we  can  indeed  perform  this  task  efficiently.  These 
results,  which  are  reported  in  [2],  have  been  implemented  in  our  SamIam 
system.  We  now,  therefore,  have  the  nucleal  algorithm  for  developing  a  very 
practical  and  effective  engine  for  aiding  decision  makers  in  examining  the 
robustness  of  most  like  scenarios  with  respect  to  parameter  changes.  For 
example,  if  a  critical  scenario  turns  out  too  sensitive  to  some  parameter,  a 
decision  maker  may  then  expend  more  resources  to  accurately  estimate  that 
parameter,  as  a  measure  to  enhance  their  confidence  in  any  decision  they 
make  based  on  the  scenario. 

Sensitivity  analysis  in  graphical  models  rely  on  the  ability  to  do  prob¬ 
abilistic  inference  efficiently.  It  is  well  known  that  the  efficiency  of  this 
inference  is  tied  to  the  topology  (connectedness)  of  graphical  models,  where 
heavily  connected  models  are  known  to  be  hard  computationally.  We  have 
had  a  long  tradition  of  work  that  deals  with  this  problem,  which  has  focused 
on  exploiting  the  structure  exhibited  by  model  parameters  (in  addition  to 
that  exhibited  by  network  topology).  Our  main  accomplishments  on  this 
subject  have  been  reported  in  [4],  which  extend  our  previous  results  in  [3]. 
These  results  show  that  by  exploiting  parametric  structure,  we  can  solve 
(and  exactly)  models  whose  topology  make  them  completely  outside  the 
scope  of  classical  inference  methods.  Hence,  we  are  now  able  to  perform 
sensitivity  analysis  on  these  models,  were  we  could  not  before.  The  corre¬ 
sponding  results  have  already  been  implemented  and  released  in  our  Ace 
system  available  at  http://reasoning.cs.ucla.edu/ace/. 

We  have  also  pursued  a  new  direction  in  approximate  inference,  during 
the  last  phases  of  this  project,  which  simplifies  the  network  topology  by 
deleting  edges  from  a  given  model.  This  is  known  to  produce  approximate 
models,  but  the  goal  is  then  to  make  the  new  approximate  model  as  close  as 
possible  to  the  original  model  in  order  to  minimize  the  discrepancy  between 
the  exact  and  approximate  answers.  Our  accomplishments  on  this  front  have 
been  quite  extensive  and  are  reported  in  [5,  7,  8,  6]. 

We  finally  note  that  we  have  applied  our  sensitivity  engine  to  a  real- world 
problem  that  involves  hundreds  of  sensors  from  the  domain  of  electrical 
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power  systems  used  by  NASA  on  a  number  of  space  vehicles.  The  system 
we  worked  with  is  part  of  the  Advanced  Diagnostic  and  Prognostic  Testbed 
(ADAPT)  at  NASA  Ames  http://ti.arc.nasa.gov/projects/adapt/. 


3  Personnel  Supported 

Hei  Chan  (Graduate  student),  Mark  Chavira  (Graduate  Student),  Arthur 
Choi  (Graduate  student),  Keith  Cascio  (Staff  Programmer)  and  Adnan  Dar- 
wiche  (PI). 

4  Honors  and  Awards 

The  PI  was  elected  in  2007  as  a  AAAI  Fellow.  This  is  the  fellow  program  of 
the  Association  for  the  Advancement  of  Artificial  Intelligence  (AAAI)  which 
was  started  in  1990  to  recognize  individuals  who  have  made  significant, 
sustained  contributions — usually  over  at  least  a  ten-year  period — to  the  field 
of  artificial  intelligence.  The  PI  citation  reads: 

For  significant  contributions  to  the  development  and  application 
of  both  probabilistic  and  logical  methods  in  automated  reason¬ 
ing. 

The  PI  has  also  been  selected  to  serve  a  four  year  term  in  the  Journal  of 
Artificial  Intelligence  Research  (JAIR),  first  as  an  Associate  Editor-in-chief 
for  2007-2008,  and  then  as  Editor-in-chief  for  2009-2010. 

The  PI  group  won  the  Gold  Medal  (first  place)  at  the  2007  international 
competition  for  satisfiability  testing.  This  is  a  world-wide,  extremely  com¬ 
petitive  event  that  takes  place  every  two-years.  Our  winning  SAT  solver, 
RSAT,  has  been  downloaded  more  than  a  1000  times  since  its  release,  with 
most  downloads  taking  place  since  it  was  announced  as  the  winner  of  the 
SAT’07. 

The  PI  group  was  the  only  team  to  solve  all  problem  instances  at  the 
International  Evaluation  of  Exact  Probabilistic  Reasoning  Systems,  which 
took  place  at  the  uncertainty  in  AI  conference  (UAI)  in  2006. 

5  Publications 

Following  are  the  relevant  publications,  referenced  in  the  above  description. 
These  publications  are  available  at:  reasoning.cs.ucla.edu 
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